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1.  Introduction 


The  purpose  of  this  report  is  to  provide  the  results  from  the  Engineering  Evaluation 
and  Assessment  (EE&A)  for  the  Symbolie  and  Sub-symbolie  Roboties  Intelligenee 
Control  System  (SS-RICS),  a  roboties  eontrol  arehiteeture. 

The  US  Army  Researeh  Eaboratory’s  Human  Researeh  and  Engineering 
Direetorate  has  been  developing  SS-RICS  sinee  2006  (Kelley  2006).  SS-RICS  has 
been  the  integration  platform  for  many  roboties  algorithms  using  a  variety  of 
different  diseiplines  from  eognitive  psyehology,  eomputer  seienee,  and  artifieial 
intelligenee.  The  eapabilities  of  SS-RICS  are  broad,  and  an  EE&A  was  needed  to 
test  those  operation  capabilities  in  an  empirical  setting. 

The  development  of  SS-RICS  has  been  documented  in  conference  papers  (Kelley 
2006;  Avery  et  al.  2006).  The  algorithms  for  episodic  memory  (Kelley  and  McGhee 
2013;  Kelley  2014),  learning  generalization  (Kelley  and  Eong  2010),  and  improved 
human-robot  interaction  (Cassenti  et  al.  2009,  2012)  have  been  chronicled  as  well. 
The  system  has  served  as  a  platform  for  insights  into  developmental  psychology 
(Kelley  and  Cassenti  2011;  Kelley  2014)  and  robot  consciousness  (Eong  and  Kelley 
2009a,b). 

SS-RICS  is  a  production-system,  goal-oriented,  robotics  control  system  based  on 
the  cognitive  architecture  Adaptive  Character  of  Thought-Rational  (Anderson  and 
Eebiere  1998).  Development  of  the  system  has  leveraged  heavily  from  biological 
and  human  capabilities  for  navigation,  action  selection,  and  memory  decay. 

2.  Mission  Need 


SS-RICS  is  currently  supporting  the  Robotics  Collaborative  Technology  Alliance 
(RCTA)  for  design  and  development  of  algorithms  and  capabilities  for  small 
unmanned  ground  vehicles  (UGVs).  The  RCTA’s  current  focus  is  research  of  small 
UGVs  capable  of  providing  reconnaissance  and  intelligence  in  support  of  a  squad. 

Several  test  scenarios  have  been  proposed;  the  current  scenario  being  researched  is 
to  “cover  the  back  of  the  building”,  where  a  UGV  is  tasked  to  provide  security  at 
the  back  of  a  building. 

3.  System  Design 

The  development  of  SS-RICS  was  inspired  by  the  separation  of  knowledge 
representation  into  symbolic  and  discrete  components  and  sub-symbolic,  metric 
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components.  SS-RICS  was  inspired  by  early  work  done  on  cognitive  architectures, 
which  were  essentially  production  systems.  This  led  to  the  development  of  3  basic 
sections  for  SS-RICS:  Working  Memory  (WM),  Perception,  and  Long-Term 
Memory  (LTM)  (Fig.  1). 


Working  Memory 


t 


Goals 


\ 


Goals 


Perception 


Stimulus 


Goal  4 


Fig.  1  SS-RICS  design.  LTM,  or  Conceptual  Memory,  contains  a  symbolic,  relational 
database.  WM  is  a  goal  stack  similar  to  a  production  system.  Sub-symbolic  or  metric 
information  is  bandied  by  multiple  simultaneous  algorithms. 


At  the  core  of  SS-RICS  is  a  production  system  architecture.  The  production  system 
simulates  the  functionality  of  human  WM.  The  basic  unit  of  knowledge,  or  WM 
element,  is  a  fact.  Facts  are  composed  of  a  tuple:  name,  type,  and  slot.  For  example, 
a  fact  might  contain  information  such  as  Location234  color  value=red.  In  this 
example,  Location234  is  the  name  of  the  fact,  the  type  of  the  fact  is  “color”,  and  the 
slot,  which  has  the  name  of  “value”  is  defined  as  “red”. 

Perception  is  composed  of  sub-symbolic  processors  that  all  run  in  parallel  and  feed 
information  to  WM.  These  processors  create  facts  for  WM  to  operate  upon 
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depending  on  the  goal  within  WM.  They  can  perform  a  variety  of  tasks,  such  as 
search  for  a  color,  search  for  a  face,  move  the  robot,  and  keep  track  of  state 
information.  The  important  part  of  the  sub-symbolic  processor  implementation  is 
that  the  processors  all  work  in  parallel  to  inform  WM,  and  WM  selects  appropriate 
information  based  on  goals  and  sub  goals. 

LTM  is  used  for  conceptual  storage,  and  its  implementation  is  similar  to  that  of  a 
relational  database  or  a  semantic  web.  LTM  is  built  upon  ConceptNet  from  the 
Massachusetts  Institute  of  Technology  (Liu  and  Singh  2004),  but  it  is  anticipated  that 
this  will  expand  as  SS-RICS  matures.  The  information  in  LTM  is  conceptual, 
symbolic,  and  factual  information  that  can  be  queried  to  return  results  to  WM.  For 
example,  LTM  could  be  queried  to  determine  that  a  “Soldier  is  also  a  Person”.  This 
would  allow  information  that  is  already  known  by  the  system  about  a  person  to  be 
applied  to  Soldiers  as  well.  This  is  only  one  example  of  the  kind  of  query  that  can 
be  accomplished  by  LTM. 

By  integrating  Perception  with  WM  and  LTM  we  believe  we  are  capturing  the 
major  components  of  cognition  at  a  functional  level.  Certainly,  many  more 
components  of  cognition  could  be  represented,  and  this  is  not  an  exhaustive  list  of 
the  components  of  cognition  within  SS-RICS,  but  it  represents  the  high-level 
architectural  breakout  of  the  system. 

SS-RICS  is  a  Windows-based  computer  program  designed  to  run  under  the 
Windows  operating  system.  It  was  developed  using  the  Microsoft.Net  framework. 
It  is  capable  of  running  both  managed  and  unmanaged  code  and  is  currently  being 
upgraded  to  run  on  64-bit  systems  and  expanded  to  run  across  multiple  computer 
processing  units. 

4.  Data  Sources 


Testing  was  conducted  in  multiple  phases  at  Aberdeen  Proving  Ground  in 
Aberdeen,  Maryland.  A  list  of  all  the  algorithms  available  for  testing  is  contained 
in  Table  1.  The  first  phase  of  the  testing  had  4  of  the  algorithms  listed  in  Table  1: 
hearing  (dictation),  face  recognition,  novelty  recognition,  and  navigation. 
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Table  1  Experiment  breakout  for  gender,  path,  noise,  and  number  of  runs 


Gender 

Path 

Noise 

No.  runs 

M 

A 

65  dB 

10 

F 

A 

65  dB 

10 

M 

B 

80  dB 

10 

F 

B 

80  dB 

10 

M 

A 

No  noise 

10 

F 

B 

No  noise 

10 

The  first  phase  had  the  SS-RICS  recognize  an  operator’s  face,  recognize  operator 
voice  commands,  navigate  to  a  location  without  hitting  any  objects,  and  return  to 
the  home  location.  The  goal  was  to  do  this  at  an  80%  success  rate,  to  include 
completing  all  of  the  subtasks.  In  addition  to  navigation,  the  test  included  higher- 
level  cognitive  tasks.  During  the  navigation  SS-RICS  was  required  to  recognize 
“interesting”  or  “novel”  locations.  The  test  scenario  is  described  in  more  detail  in 
Section  6. 

5.  Accomplishments 

•  SS-RICS  was  tested  to  be  capable  of  responding  to  voice  input  using  a 
microphone  to  execute  one  step  of  the  production  system  (i.e.,  one 
command).  The  command  set  was  limited  to  approximately  20  commands. 
Commands  also  included  a  series  of  actions  that  can  be  triggered  by  one 
command;  for  example,  “Go  to  the  Conference  Room”. 

•  The  voice  recognition  command  set  was  tested  with  one  woman  and  one 
man. 

•  The  voice  recognition  was  tested  with  a  background  noise  of  65/80  dB  of 
constant  white  noise. 

•  SS-RICS  was  tested  to  be  capable  of  recognizing  a  specific  operator’s  face 
following  a  period  of  learning  and  training.  This  learning  and  training  period 
took  no  more  than  5  min. 

•  SS-RICS  was  capable  of  navigating  to  a  specific  location,  without  hitting 
any  objects,  using  a  previously  defined  map. 

•  SS-RICS  was  capable  of  returning  to  a  “home”  location  after  each 
completed  navigation  procedure  without  hitting  any  objects. 

•  SS-RICS  was  capable  of  recognizing  interesting  or  novel  points  in  the 
navigation  environment. 
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The  remainder  of  this  report  foeuses  on  details  of  the  operational  testing  and 
comparisons  of  facial  recognition  algorithms. 

6.  Operational  Testing 

Testing  was  a  within-subject  2  (gender)  x  2  (paths)  x  3  (noise  level)  design.  Gender 
testing  was  conducted  because  previous  pilot  tests  showed  differences  in  voice 
recognition  based  on  gender.  Path  testing  was  conducted  to  test  the  navigation 
algorithms  (simultaneous  localization  and  mapping  [SLAM])  and  the  landmark 
designation  algorithms.  Background  noise  was  added  to  see  what  effect  this  had  on 
voice  recognition.  Each  noise  level  was  run  10  times  per  gender,  yielding  60  total 
runs. 

Two  paths  were  chosen  for  testing  (Paths  A  and  B)  of  relatively  equal  length  and 
complexity.  At  the  end  of  each  run  the  completions  were  noted:  complete  or  not 
complete.  The  path  was  considered  complete  when  the  robot  reached  the  final 
destination  point  and  then  returned  to  the  home  location. 

Two  noise  levels  were  tested:  65  and  80  dB  of  white  noise,  with  a  baseline  of  no 
noise.  Decibels  levels  were  measured  prior  to  the  path  runs  (A,  B).  Noise  levels 
were  reversed  for  each  gender.  Males  started  with  no  noise  and  increased.  Females 
started  with  80  dB  and  decreased.  Voice  recognition  was  true  or  false  for  whether 
or  not  the  command  was  recognized  on  the  first  utterance. 

Face  recognition  was  tested  as  either  true  or  false  at  the  beginning  of  each  run,  with 
the  operator  showing  their  face  following  some  period  when  their  face  was  not 
visible. 

7.  Face  Recognition  Algorithm  Comparison 

Three  models  of  face  recognition  algorithms  are  available  in  SS-RICS:  EigenFaces, 
FisherFaces,  and  Focal  Binary  Pattern  Histograms  (FBPHs).  These  were  all 
provided  by  the  package  openCV  (www.openCV.org).  We  ran  initial  tests  on  all  3 
face  recognition  algorithms  on  a  variety  of  subjects,  male  and  female,  and  then 
settled  on  FBPHs.  The  algorithm  comparison  follows. 

Nine  subjects  (6  men,  3  women)  were  used  to  train  each  model  with  10  still  video 
images  of  each  subject  comprising  the  inner  mask  of  the  face  from  approximately 
the  eyebrows  to  the  lower  lip  and  largely  without  ears  or  extraneous  background  or 
clothing.  Each  image  was  approximately  130  x  130  resolution  and  scaled  to  200  x 
200  for  training  the  model. 
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Each  face  used  for  classification  (all  from  the  pool  of  9)  was  captured  by  the  same 
software  mechanism  that  captured  the  faces  for  training  at  a  resolution  of 
approximately  the  same  130  x  130  and  scaled  up  to  200  x  200  for  both  training  and 
classification. 

All  faces  for  training  and  classification  had  the  same  lighting  parameters  and  were 
captured  in  the  same  locale.  All  images  were  grayscaled  prior  to  training  or 
classification  (each  model  requires  this). 

Each  classification  test  involved  capturing  the  candidate’s  face  for  a  total  of  100 
frames  and  using  the  3  models  to  classify  it.  The  results  were  compared  with  the 
ground  truth  of  who  the  candidate  actually  was. 

Of  the  9  training  subjects,  subjects  2,  5, 7,  8,  and  9  were  available  for  further  testing 
and  training  (Tables  2-6). 


Table  2  Testing  subject  2 


Testing  subject  2 

EigenFaces 

FisherFaces 

LBPHs 

Subject  1 

Subject  2 

28 

73 

76 

Subject  3 

0 

11 

2 

Subject  4 

0 

0 

0 

Subject  5 

41 

0 

0 

Subject  6 

31 

0 

22 

Subject  7 

0 

0 

0 

Subject  8 

0 

16 

0 

Subject  9 

0 

0 

0 

Percentage  of  correct  classifications  by  model: 


LBPHs  =  76% 
FisherFaces  =  73% 
EigenFaces  =  28% 
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Table  3  Testing  subject  5 


Testing  subject  5 

EigenFaces 

FisherFaces 

LBPHs 

Subject  1 

0 

0 

0 

Subject  2 

0 

0 

0 

Subject  3 

0 

15 

0 

Subject  4 

0 

0 

0 

Subject  5 

99 

85 

100 

Subject  6 

1 

0 

0 

Subject  7 

0 

0 

0 

Subject  8 

0 

0 

0 

Subject  9 

0 

0 

0 

Percentage  of  correct  classifications  by  model: 
LBPHs  =  100% 

FisherFaces  =  85% 

EigenFaces  =  99% 

Table  4  Testing  subject  7 

Testing  subject  7 

EigenFaces 

FisherFaces 

LBPHs 

Subject  1 

0 

0 

0 

Subject  2 

0 

0 

0 

Subject  3 

0 

0 

3 

Subject  4 

0 

2 

1 

Subject  5 

0 

0 

0 

Subject  6 

0 

0 

18 

Subject  7 

100 

96 

78 

Subject  8 

0 

0 

0 

Subject  9 

0 

0 

0 

Percentage  of  correct  classifications  by  model: 


LBPHs  =  78% 
FisherFaces  =  96% 
EigenFaces  =  100% 
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Table  5  Testing  subject  8 


Testing  subject  8 

EigenFaces 

FisherFaces 

LBPHs 

Subject  1 

2 

0 

0 

Subject  2 

0 

0 

0 

Subject  3 

0 

0 

0 

Subject  4 

0 

0 

0 

Subject  5 

0 

0 

1 

Subject  6 

0 

0 

0 

Subject  7 

0 

0 

0 

Subject  8 

98 

100 

99 

Subject  9 

0 

0 

0 

Percentage  of  correct  classifications  by  model: 
LBPHs  =  99% 

FisherFaces  =  100% 

EigenFaces  =  98% 

Table  6  Testing  subject  9 

Testing  subject  9 

EigenFaces 

FisherFaces 

LBPHs 

Subject  1 

0 

0 

0 

Subject  2 

0 

0 

1 

Subject  3 

6 

24 

1 

Subject  4 

0 

4 

0 

Subject  5 

45 

0 

4 

Subject  6 

1 

0 

4 

Subject  7 

0 

0 

0 

Subject  8 

12 

0 

0 

Subject  9 

36 

73 

90 

Percentage  of  correct  classifications  by  model: 


LBPHs  =  90% 
FisherFaces  =  73% 
EigenFaces  =  36% 


The  model  that  worked  best  overall  (had  the  majority  of  correct  classifications  over 
the  test  period)  was  the  LBPHs.  FisherFaces  scored  second  most  accurate  and 
EigenFaces  third.  So  we  chose  the  LBPHs  method  to  use  for  these  tests’  facial 
recognition  requirement. 
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8.  Test  Results 


8.1  Overall  Reliability 

Overall,  for  the  4  algorithms  tested  (navigation,  landmark  designation,  voice 
recognition,  and  face  recognition)  the  reliability  rate  was  very  high  for  both  genders. 
Overall  reliability  was  above  96%  for  60  runs  (Fig.  2). 

SS-RICS  Overall  Reliability  Rate 


Female  Male 

Gender 

Fig.  2  Overall  SS-RICS  reliability  rate  for  both  genders 


8.2  Navigation 

For  the  test  procedure,  SS-RICS  was  commanded  by  the  operator  to  proceed  to 
either  of  2  goals:  a  mannequin  or  a  street  sign.  The  path  to  each  location  was 
approximately  equal  in  distance  (-8  m).  The  goals  were  alternating  over  60  runs, 
with  30  runs  using  a  male  operator  and  30  runs  using  a  female  (see  Table  1). 

SS-RICS  actually  performed  a  navigation  task  more  than  60  times  since  the  operator 
had  to  return  the  robot  to  the  home  location  at  the  beginning  of  each  run.  In  other 
words,  a  typical  run  would  include  going  to  the  either  the  mannequin  or  the  street 
sign  then  returning  to  the  home  location. 

Results  from  each  navigation  task  were  coded  as  a  binary  event:  the  robot  made  it 
to  the  end  location  or  it  did  not.  These  were  coded  at  the  end  of  each  run. 
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Overall,  there  was  a  96%  success  rate  for  both  men  and  women  for  SS-RICS  over 
the  course  of  60  runs  (Fig.  3). 


Navigation  Reliability  Rate 


1 


0.8 


O 


— 

a.  0.4 

E 

o 

u 

o.z 


0 


0.96  0.96 


Male 

Gender 

Fig.  3 

Navigation  reliability  rate 

8.3  Voice  Recognition 

For  the  voice  recognition  test  procedure,  SS-RICS  was  commanded  by  the  operator 
to  navigate  to  a  1  of  2  goals.  This  command  was  given  by  the  operator  as  a  voice 
input  using  a  wireless  microphone  mounted  on  the  operator’s  face  in  front  of  the 
operator’s  mouth.  Before  the  start  of  the  trials,  the  operator’s  voice  (both  male  and 
female)  was  trained  using  the  Microsoft’s  voice  recognition  system,  which  is 
integrated  into  SS-RICS  to  allow  for  voice  commands  to  be  given  to  the  robot 
(Fig.  4).  The  voice  training  period  took  approximately  10  min  each  to  complete  for 
both  the  male  and  female  operators. 
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Fig.  4  Overhead  view  of  decibel  meter  placement 

Each  operator  was  tested  under  3  levels  of  background  noise:  no  noise,  65  dB,  and 
80  dB  (see  Table  1).  The  background  noise  was  generated  by  SS-RICS  and  sent 
through  the  computer  speakers.  A  decibel  meter  was  used  to  measure  the  average 
decibel  output  from  the  computer  speakers.  The  decibel  meter  was  placed 
approximately  12  inches  from  the  computer  speakers  producing  the  background 
noise.  The  overall  recognition  rate  was  96%  for  males  and  100%  for  females 
(Fig.  5). 


Voice  Reliability  Rate  for  3  DB  levels 
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Fig.  5  Voice  reliability  rate  for  3-dB  levels 
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8.4  Face  Recognition 


Face  recognition  was  conducted  before  each  run  using  the  LBPHs  method.  Each 
operator  was  trained  by  the  SS-RICS  LBPHs  face  recognition  algorithm.  Training 
took  less  than  10  min  to  complete  for  each  subject. 

At  the  beginning  of  each  run,  the  operator  would  stand  out  of  the  view  of  robot’s 
camera  so  that  SS-RICS  could  not  see  the  operator’s  face.  Once  the  run  began,  the 
operator  would  move  in  front  of  the  robot’s  camera  so  that  SS-RICS  could  identify 
the  operator. 

Since  there  is  an  oscillation  in  the  face  recognition  algorithm  over  each  frame,  a  set 
of  100  frames  was  collected  to  determine  the  identity  of  the  operator  over  a 
sequence  of  frames.  These  100  frames  were  then  averaged  to  produce  a  final 
determination  of  the  identity  of  the  operator.  SS-RICS  had  a  collection  of  11 
possible  operators  with  which  to  match  to  the  current  operator. 

Results  were  remarkably  high  and  higher  than  the  test  and  evaluation  goal  of  80%. 
The  average  was  99%  each  for  both  the  female  and  male  operator  (Table  7). 


Table  7  Results  for  facial  recognition 


Test  subject  “Bill” 

100% 

29  runs 

98% 

1  run 

Average:  99.93% 

Test  subject  “Kristin” 

100% 

23  runs 

99% 

1  run 

98% 

2  runs 

96% 

2  runs 

93% 

1  run 

92% 

1  run 

Average:  99% 


8.5  Landmark  Designation 

The  landmark  designation  algorithm  finds  locations  on  a  map  that  can  be  used  for 
landmarks  as  reference  points  if  the  metric  map  changes.  One  disadvantage  of 
SLAM  and  other  metric  mapping  techniques  is  that  each  point  on  a  metric  map  is 
just  as  important  as  every  other  point,  so  there  are  no  landmarks  that  can  be  used 
for  navigation  in  a  dynamic  environment.  If  the  small  metric  details  of  a  map 
change,  the  landmarks  should  still  be  present. 
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Our  definition  of  a  landmark  is  an  important  location,  relative  to  all  other  locations, 
in  the  map  that  facilitates  future  navigation  and  localization.  For  example,  in  our 
test  scenarios,  the  home  location  and  each  one  of  the  goal  locations  would  be 
considered  landmarks  (Fig.  6). 
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Fig.  6  Landmark  designations 


Testing  was  used  to  determine  if  SS-RICS  would  designate  the  home  location  and 
each  one  of  the  goal  locations  (the  mannequin  and  the  sign)  as  landmarks.  This 
landmark  designation  algorithm  has  been  detailed  in  a  previous  report  (Kelley  and 
McGhee  2013). 

The  landmark  designation  algorithm  is  stochastic.  Over  the  course  of  the  same  path, 
SS-RICS  might  designate  a  landmark  at  slightly  different  locations.  While  the 
algorithm  is  stochastic,  it  responds  within  a  normal  distribution  of  values.  Thus,  the 
algorithm  was  tested  to  see  whether  or  not  it  was  relatively  stable  across  the  testing 
area  for  landmark  designation.  As  previously  mentioned,  the  algorithm  should 
designate  the  home  location  and  the  2  goal  locations  as  landmarks.  As  can  be  seen 
in  Fig.  6,  SS-RICS  designated  the  home  location,  the  goal  locations,  and  other 
critical  navigation  areas  (the  protrusions  from  the  maze)  as  landmarks  over  60  runs, 
which  is  an  acceptable  level  of  performance. 

Since  the  evaluation  of  this  version  of  the  algorithm,  the  algorithm  has  been 
improved,  so  that  when  the  robot  travels  over  a  previously  designated  area,  it 
retrieves  existing  landmarks.  This  strengthens  their  activations  (Anderson  and 
Lebiere  1998),  thereby  reducing  the  stochasticity  of  the  algorithm  and  reducing  the 
number  of  landmark  sites. 
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9.  Conclusions 


SS-RICS  performed  well  over  the  eourse  of  60  runs,  testing  4  major  algorithms, 
using  3  levels  of  white  baekground  noise,  2  path  designations,  and  2  gender  types 
as  operators.  As  ean  be  seen  in  Fig.  7  the  reliability  percentages  were  higher  than 
the  previously  set  goal  of  80%.  Other  algorithms  within  SS-RICS  will  be  tested  in 
the  future  to  ascertain  there  overall  level  of  reliability. 

Testing  with  multiple  operators,  of  different  genders,  ethnicities,  and  socio¬ 
economic  backgrounds  might  cause  the  system  more  errors  and  will  be  the  focus  of 
future  evaluations. 

See  the  Appendix  for  future  algorithm  test  scenarios. 
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Appendix.  List  of  Algorithms  for  Possible  Testing 
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Table  A-1  presents  algorithms  for  future  testing  and  includes  references  to  the 
Adaptive  Resonance  Theory  (ART)  of  Neural  Networks.  * 

Table  A-1  List  of  algorithms  for  possible  testing 


Algorithm 

Description 

Batch  or 
iterative 

Testing 

Face  instance 

Recognize  a  specific 
face  given  training. 

Iterative 

YES 

Face  recognition 

Recognize  any  person’s 
face. 

Batch 

YES 

Face  (left  eye) 

Recognize  any  person’s 
left  eye. 

Batch 

NO 

Face  (right  eye) 

Recognize  any  person’s 
right  eye. 

Batch 

NO 

Face  (profile) 

Recognize  any  person’s 
profile. 

Batch 

NO 

Face  (mouth) 

Recognize  any  person’s 
mouth. 

Batch 

NO 

Body  (full) 

Recognize  any  person’s 
body. 

Batch 

NO 

Body  (upper) 

Recognize  any  person’s 
upper  body. 

Batch 

NO 

Body  (lower) 

Recognize  any  person’s 
lower  body. 

Batch 

NO 

Motion  (turning) 

Robot  will  turn  a 
specific  degree. 

Robot  will  move 

Iterative 

YES 

Motion 

forward  or  backward  a 

Iterative 

YES 

(forward/backward) 

certain  number  of 

meters. 

Motion  (obstacle 
avoidance) 

Robot  will  avoid  objects 
in  the  front. 

Iterative 

YES 

Speech 

Robot  will  speak 
written  text. 

Iterative 

YES 

Robot  will  listen  to  and 

Flearing  (free) 

convert  a  spoken 
sentence  into  text.  Any 

Iterative 

NO 

words  can  be  used. 

Robot  will  listen  to 

Hearing  (dictation) 

certain  key  words  within 

Iterative 

YES 

a  command  set. 

Robot  will  parse  a 

Natural  language 

sentence  for  parts  of 
speech  (noun,  verb, 

Iterative 

NO 

adverb). 

'  Carpenter  GA,  Grossberg  S.  Adaptive  resonance  theory.  In:  Arbib  MA,  editor.  The  handbook  of  brain 
theory  and  neural  networks,  2nd  ed.  Cambridge  (MA):  MIT  Press;  2003.  p.  87-90. 
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Table  A-1  List  of  algorithms  for  possible  testing  (continued) 


Algorithm 


Description 


Batch  or 
iterative 


Testing 


Navigation 

Navigation 
(Simultaneous 
Localization  and 
Mapping) 

Choice 

Vision  (template 
match) 

Vision  (image 
correlation) 

Vision  (color) 
Vision  (movement) 

Vision  (tracking 
learning  detection ) 

Vision  (salience) 

Vision  (salience) 
Concepts 

Novelty  recognition 

Episodic  learning 

Neural  networks 


Robot  will  use  a 
pre-existing  map  to 
navigate  to  certain 
predefined  locations. 

Robot  can  build  a  map 
and  simultaneously 
localize  within  the  map. 

Robot  can  use  a 
stochastic  methodology 
for  making  choices  in  an 
environment. 

Can  identify  a  snippet 
within  a  larger  visual 
field. 

Can  correlate  the  current 
scene  with  a  saved  scene 
and  return  the 
correlation  value 

Can  identify  colors 
Can  identify  that  an 
object  is  moving 
Can  track  objects 
identified  with  a 
bounding  box 

Can  identify  the  most 
salient  item  in  a  scene 
(based  on  psychological 
theory) 

Can  segment  an  object 
from  a  background 
Can  relate  concepts  to 
each  other  (how  similar 
is  a  dog  and  a  cat?) 

Can  identify  new 
streams  of  information 
as  being  novel  from 
previous  streams  of 
information 

Can  learn  from 
experience  using 
previous  episodes  so  that 
the  robot  can  anticipate 
events 

Can  recognize  laser  data 
using  neural  networks 


Iterative  YES 

Iterative  YES 

Iterative  NO 

Batch  NO 

Batch  NO 

Batch  NO 

Batch  NO 

Batch  NO 

Batch  NO 

Batch  NO 

Iterative  NO 

Batch  YES 


Iterative  NO 


Batch  NO 
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Table  A-1  List  of  algorithms  for  possible  testing  (continued) 


Algorithm 

Description 

Batch  or 
iterative 

Testing 

Neural  networks 

Can  recognize  laser  data 

Batch 

NO 

(ART) 

using  ART  neural 
networks 

The  robot  has  memory 

Memory  decay 

decay  algorithms  similar 

Iterative 

NO 

(standard) 

to  human  memory  decay 

algorithms 

Memory  decay 
(habit) 

The  robot  has  memory 
decay  algorithms  similar 
to  low  level  neurons 

Iterative 

NO 

which  exhibit 

habituation 

The  robot  has  a 

Production  system 

production  system  used 
for  selecting  behaviors 

Iterative 

YES 
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List  of  Symbols,  Abbreviations,  and  Acronyms 


ART 

Adaptive  Resonance  Theory 

EE&A 

Engineering  Evaluation  and  Assessment 

EBPHs 

Eocal  Binary  Pattern  Histograms 

ETM 

Eong-Term  Memory 

RCTA 

Robotics  Collaborative  Technology  Alliance 

SEAM 

Simultaneous  Eocalization  and  Mapping 

SS-RICS 

Symbolic  and  Sub-symbolic  Robotics  Intelligence  Control  System 

UGV 

unmanned  ground  vehicle 

WM 

Working  Memory 
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